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1. Abstract 

This paper describes a 3-D world Modeling technique using range data. Range data quantify 
the distances from the sensor focal plane to the object surface, i.e.. the 3-D coordinates of 
discrete points on the object surface are known. The approach proposed herein for 3-0 w>rld 
modeling is based on the Combinatorial Geometry (CG) Method which is widely used In Monte Carlo 
particle transport calculations. First, each measured point on the object surface is surrounded 
by a small sphere with a radius determined by the range to that point. Then, the 3-D shapes of 
the visible surfaces are obtained by taking the (Boolean) union of all the spheres. The result 
is an unambiguous representation of the object's boundary surfaces. The "p re- learned" partial 
knowledge of the environment can be also represented using the CG fethod with a relatively small 
amount of data. Using the CG type of representation, distances in desired directions to boundary 
surfaces of various objects are efficiently calculated. This feature is particularly useful for 
continuously verifying the world model against the data provided by a range finder, and for inte- 
grating range data from successive locations of the robot during motion. The efficiency of the 
proposed approach is illustrated by simulations of a spherical robot in a 3-D room in the presence 
of moving obstacles and inadequate pre-learned partial knowledge of the environment. 

2. Introduction 

An autonomous robot must have sensory capability to deal with unknown or partially known environments. 

The sensor derived data need to be processed to an appropriate internal representation of the external world. 

The external world to be described is fundamentally three-dimensional. Involving object occlusion. Most compu- 
ter vision research performed during the past twenty years has concentrated on using intensity images as sensor 
data. The imaging hardware (cameras) for these studies typically project a three-dimensional scene onto a 
two-dimensional image plane, thus providing a matrix of gray level values representing the scene from a given 
viewpoint. These values Indicate the brightness at points on a regular spaced grid and contain no explicit 
information about depth. Methods that use intensity information only for deriving 3-D structure are nsually 
computationally intensive. This computationally expensive processing arises due to the fact that correspon- 
dence of points between different views must be established and a complex system of nonlinear equations must 
be sol ved([l]-[5]) . 

In recent years digitized range data have become available from both active and passive sensors, *nd the 
quality of these data has been steadily improving([6]-[8]). Range data quantify the distances from the sensor 
focal plane to an object surface. Since depth information depends only on geometry and is independent of illu- 
mination and reflectivity, intensity image problems with shadows and surface markings do not occur. Therefore, 
the process of representing 3-D objects by their shape should be less difficult in range images than in intensity 
images. The problem addressed by this paper is the external world modeling using range data. Unique require- 
ments for such a model are: 

a) Allow representation of a general 3-D unknown or partially known environment, based on range data. 

b) Allow for minimal fast memory for storage. 

c) Allow the introduction of a feedback loop for continuous verification of the world model against the 
data provided by the sensor (efficient distance calculation), 

d) Allow for efficient integration of the range data from multiple views. 

e) Allow for efficient navigation and manipulation. 

A wide variety of techniques have been developed for representing 3-D objects for digital computing pur- 
poses. There are methods which describe the surface boundary and methods which represent the object's volume. 

The simplest boundary representation is using n-sided planar polygons (triangles, quadrilaterals, etc.) which 
can be stored as a list of 3-D node points along with their relationship information. Arbitrary surfaces are 
approximated to any desired degree of accuracy by using many planar polygons. This type of representation is 
popular because model surface area is well defined and all object operations are carried out using piecewise- 
planar algorithms. The next step in generality is obtained using quadric surface boundary representation. More 
advanced techniques for representing curved surfaces with higher order polynomials or splines are mentioned in 
the computer graphics and CAD Hterature([9]-[12]). There are many different techniques of this type; however 
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they art generally not vary awpact In terms of data storage. nor are they computational ly efficient in calculat- 
ing distances to boundary surfaces[13]. The best known volumetric representations are the oct-tree{14] general- 
Izad QrllnderClS] and multiple 2-0 projection v1tws[16l. The generalized cylinder approach Is well salted to 
many real world shapes. However, it becomes just about Impossible to use this representation for large, thin 
objects. The multiple 2-0 projection view Is not a general purpose technique since different objects may have 
similar 2-0 projections. The oct-tree representation Is used In many world models. However, the indexing 
prob1emCl7] Is seriously affecting the efficiency of this tecnnlque. In conclusion there is a need for a fast 
and robust technique for building 3-D models of arbitrarily shaped objects. 

In Chapter 3, a proposed external world modeling procedure and an efficient distance calculation algorithm 
are presented. A technique for Integrating the range data from multiple views and a continuous verification 
procedure of the world model versus the range data provided by the sensor is illustrated in Chapter 4. Finally, 
the feasibility of the proposed approach Is Illustrated in Chapter 5 by simulations of a spherical robot navi- 
gating in a 3-0 room In presence of static and moving obstacles and Inadequate pre-leamed partial knowledge of 
the environment. 

3. Representing 3-D Surfaces Using the Combinatorial geometry 

The basic problem addressed In this paper is one of representation. The proposed approach is based on the 
Combinatorial Geometry (CG) method[18] which Is widely used in Honte Carlo simulation of particle transport in 
3-D geometries. In CG (also known as Constructive Solid Geometry (CSG) In computer graphics and CAD litera- 
ture) solids are represented as combinations of primitive solids or "building blocks" (i.e., spheres, cylinders, 
boxes, etc.) using the Boolean operations of union, intersection and difference. The storage data structure is 
a binary tree where the terminal nodes are instances of primitives and the branching nodes represent Boolean 
operators. Any 3-D known object can be represented by a (Boolean) combination of primitive solids or deformed 
superquadrics[I9]. This representation is especially suitable for describing pre-leamed partial knowledge of 
the environment. An example of describing an abject composed of two boxes, one of them with a cylindrical hole 
Is Illustrated In Fig. 1. The result Is a concise, unambiguous and complete representation of the abject volume 
and boundary surface. 
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Fig. 1. Representing a 3-D object using Combinatorial Geometry, 
a - given ooject and its CG representation, 
b - the storage data tree. 


The result of a range scan is a matrix of distances from the sensor focal plane to an object surface. In 
other words, the coordinates of discrete points on the "visible* parts of the boundary surfaces of different 
objects in the external world of the robot, are known. Let oe the (swell) angle between two successive 
"reading" directions of the sensor. First, each discrete point i, is surrounded by a small solid sphere with a 
radius, r^ - aax(R 1 sin <*, a R^, where Rj is the range to point i, and ARj is the associated measurement error. 
Then, the approximate 3-0 shape of the visible boundary surfaces is obtained directly by taking the wiion of all 
the spheres (see Fig. 2). 
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Fig. 2. Describing the shape of 3-0 objects using spheres. 


The reason for using spheres Is to keep the representation as compact as possible. Describing the sphere 
for a particular discrete point In space means adding only one additional parameter (the radius) to t.*e coor- 
dinates of the discrete point which are provided by the sensor. The radius r< is defined as r^ • «u(Rj sin «, 
4*1 ) to avoid the appearance of "holes" in the geometry and to take into account the range uncertaixty. Using 
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tills definition for rj, neighbor spheres overlap one another and the boundary surface of the union of all 
spheres Is continuous (without holes) from the robot's point of view. Finally, It Is obvious that using the 
‘sphere* procedure, the shape of the boundary surfaces Is distorted. However, the distortion Is practically 
proportional to the range to each point since the range uncertainty 1$ relatively snail. In other words, the 
resolution of the node! Is fmp roved as the range to the surface Is decreased. 

3.1. Distance Calcelatlon In CG ^presentation 

A very useful feature of the CG representation Is Its efficiency In calculating distances to 3-0 surfaces 
In a desired direction. Observing discontinuities In the range data greater than the maximum size of the robot, 
the scene Is partitioned In many different zones. A zone Is defined as the union of snail spheres located 
between two successive discontinuities In the range data. Using the storage data structure Mentioned In Chapter 

3, two tables are defined: the first one includes the spatial location of the snail spheres; the second one 

Identifies the different zones In terns of these spheres. The distance to 3-fr surfaces In a desired direction 
fro* a given point. Is calculated in two steps: 

a) Each zone Is surrounded tightly by a box (rectangular parallelepiped). Since the boxes are approxi«ate 
bounding configurations. Intersections of a given ray with a box does not necessarily 1*ply Intersection 
with any particular sphere. In addition, the different orientations of the sphere clusters Imply that 
bounding boxes can Intersect. and therefore wftiple boxes may have to be checked for penetration by a 
given ray. The box (boxes) penetrated by the ray Is determined by calculating the Intersection points 
between the boxes and the ray. A list consisting of the boxes physically penetrated by the ray. Is 
defined. The corresponding list of zones is used to determine the penetration point. 

b) Determine the small sphere penetrated by the ray and calculate the penetration point. This is done by 
considering only the spheres Included ia the zones listed in the first step. Using this approach, only 
a small number of spheres are checked for penetration, and therefore significant computation time Is 
saved. 

It should be mentioned that the boxes surrounding the zones are used only internally during distance calcu- 
lations and they are not affecting the geometric description of the 3-D surfaces. During path planning, "tenta- 
tive paths" are checked for potential collision by calculating the distances to object surfaces from scattered 
points on the robot's surface in the desired direction. These distances can be effectively calculated by using 
the CG representation, and the procedure outlined above. 

4. Updating the World Model 

Automatic construction of 3-D models of objects fro* multiple views is an important problem in computer 
vision. In the past, a number of different techniques have been used for representation and modeling of 3-D 
objects for computer vision appl icatioas([20]-[27]) . However, there is an absence of a fast and robust tech- 
nique for building 3-D models of arbitrarily shaped objects. The process of constructing 3-D models for objects 
Involves integrating the range data from multiple views. In general, the integration process performs matching 
to establish correspondence between the views, determines the tnterframe transf ormat ions to register the views 
in a common reference coordinate system and then merges the data. The difficult and time consuming step in the 
above process is the notching step required to establish a correspondence. Much of the previous research efforts 
have been directed toward solving the difficult correspondence problem. The algorithm presented in this paoer, 
does not require any correspondence between different views, because the world model uses a universal coordinate 
system with the origin arbitrarily located at the robot's initial position. According to the representation 
algorithm described in Chapter 3. the accuracy with irfifch a certain point in space may be observed by the robot 
depends upon the distance between the robot and the point. This fact is translated to the radius of the sphere 
surrounding a particular point in the CG representation. Therefore, a point in space should be kept in memory 
along with the most accurate information (shortest observation distance). In other words, for each "measured 
point" in space, the shortest observation distance in the robot's history should be determined. The main problem 
in implementing this approach is the fact that since the sampling procedure of range data is discrete, the proba- 
bility of a particular point to be sampled from two different positions of the robot is zero. In other words, 
each "measured point" is sampled just once during the robot history. The solution implemented in our approach 
follows an iterative algorithm using the "old data" acquired before the current scan and the "new data" acquired 
during the current scan: 

a) The "old data" is checked from the current position of the robot. Using the world model based on the 
"old data", distances to 3-D surfaces fro* the robot's current position in the direction of points in 
the "old data" are calculated. If the distance to 3-D surfaces is smaller than the euclidean distance 
to the sphere surrounding the point then this particular point cannot be seen fro* the current position 
of t he robot and the point ^epresentat i on is kept unchanged. ?ther>ise. the "old* radius of the 
surrounding sohere is compared with the “new" radius determined by the euclidean distance from the 
current position of the robot and the smallest radius is chosen between the old and the new radii. 

b) The "new data" acquired from the current position of the robot is checked against the "old data". If 
the "new" point (provided by the sensor) is located within the world model based on the old data (within 
a sphere surrounding an "old" point) then the new point is rejected and therefore no new sphere is added 
to the world model . 
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If the “hew” point Is outside the old world node!* then the distance to 3-D surfaces In the "new" point 
direction Is calculated (using the old world Model). If the obtained distance Is greater than the range 
to the "new* point (provided by the sensor), the "new” point Is added to the world nodel as a sphere 
with a radius determined by the range to the point. Otherwise (the obtained distance Is snaller than 
the range to the point) the "old" point (located approximately In the same direction, but closer to the 
robot) Is erased froe the node) and the "new” point Is added to the mrld nodel. This Is the case of 
moving objects. In which the "old" data should be continuously verified and updated. 

c) Verification of pre-leamed geometric knowledge of the envir o nment. 

The sensor derived data Is compared with the calculated distances obtained from scanning the pre-leamed 
geometric envi ron ment. The pre-leamed data Is represented In a very concise way using the CG repre- 
sentation. If the ”rea1” range *n a certain direction Is found to be similar (within the uncertainty 
of the pre-leamed data) to the calculated range In the same direction, the representation is kept 
unchanged and no point Is added to the world model. If the real range Is snaller than the calculated 
range, the new real point Is added to the world model. Finally. If the real range Is greater than the 
calculated range, the entire pre-leamed object Is r emoved from the world model and the "real" point is 
added to the representation. 

5. Sample Problems 

The efficiency of the proposed world nodel Is Illustrated in several simulations of a spherical robot 
navigating In a 3-D room In presence of static and moving obstacles and Inadequate pre-leamed partial knowledge 
of the environment. The robot is assumed to move In a plane parallel to the floor, along straight lines. The 
origin of coordinates is arbitrarily located at the robot’s starting position. The goal coordinates are known 
a-priori. The external world geometry, the robot starting position and the goal location are Illustrated in 
Fig. 3. The radius of the spherical robot is 3 cm. The plane of motion is 30 cm off the floor. The navigation 
algorithm used in the sample problems is described in detail In Ref. 28. 

M emm m. ■«*. 
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1 

R - The Initial position of the robot (4.0.30) 


G - The goal position (190,0,30) 

B1 - BOX; dimensions (20 x 15 x 40); Center at (30,37.5,20) 

B2 - BOX; dimensions (10 x 60 x 90); Center at (-15.35.45) 

B3 - BOX; dimensions (40 x 20 x 90); Center at (100,30,45) 

C - CYLINDER; Center of basis at (60.0,0) 

Height 60, Radius 15 

S - SPHERE; Center at (110, -20. 30) 

Radius 20 

P - PRISM; dimensions (30 x 30 x 90); Vertex at (140.-10,0) 


Room dimensions: 200 x 100 x 100 

All dimensions are In centimeters 



Fig. 3. The geometry of the room. 


To illustrate the efficiency of the proposed technique for building the world model, four sample problems 
have been considered. In the first problem the 3-0 environment is completely unknown and the robot Is repre- 
senting the surrounding environment using the range data provided by the sensor. Figures *-8 illustrate the 
plane of motion during the robot's Journey from its initial position to a final position where he can directly 
"see" the goal. The world representation Is continuously updated using the information provided by the sensor 
from different reading positions of the robot. It can be seen that as the robot proceeds to the goal the world 
representation becomes more complete. 

In the second problem (Figs. 9-13), the box B1 and the prism P are provided a-priori to the robot (pre- 
learned knowledge). The robot is verifying the accuracy of the pre-leamed information and after finding It 
correct, is representing the two objects using two CG primitives (Box and Prism), without using the sphere type 
of representation. The representation of the overall 3-0 world is thus more concise than in the first problem, 
in which the sphere procedure was used to represent all objects. 
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The external world geometry considered In the two last problems Is similar to the geometry of the first two 
problem, except that the boxes Bi, 82 end the cylinder C ere rent if Iron the scene* In the third problem the 
box 83 end the prism P ere defined as pee- learned Information which ( Intentionally) was provided Inaccurately to 
the robot. Froe Figs* 14-17 It can be seen that the robot Is verifying the pro- learned data and finding that 
the box Is inaccurately positioned (Fig. 14) is using the sensor (real) data only to represent It (Figs* IS and 
16). At a later stage, (Fig. 17) the robot can directly check the pro- learned information for the prism (which 
was previously occluded) and finding it Incorrect Is removing the prism from arnwry. The prism fs then accu- 
rately represented using the data provided by the sensor. 

In the last example, the box and the prism are correctly provided as pre- learned information, and the 
"unknown* sphere Is moving forward and backward between successive positions of the robot. Figure 18 Illustrates 
the environment with the sphere at its initial position. While the robot is moving to the second position (Fig. 
19) the sphere is moving forward. The previous information about the sphere Is then checked, found Incorrect and 
r e mov ed from the robot's memory. Finally, Wien the robot Is reaching the next (third) position, the sphere has 
moved back to Its initial position. It can be seen (Fig. 20) that the robot is keeping the previous information 
about the sphere, since It is now occluded the "real* data and therefore cannot be verified. If at a later 
stage the robot is again In a position to directly "see" the "old" position of the sphere, this previous Infor- 
mation will be checked and eventually removed from the world model. 

These and the following figures shown in this paper have been produced using a computer printer and a very 
simple plotting routine. Since the maximum resolution of the printer along the Y axis (across the page) Is 130 
characters, certain existing spheres having diameters smaller than the printer resolution are not printed and 
therefore some "holes" may artificially appear on surfaces which are la fact continuous. 

6. Conclusion 

The proposed approach for modeling the external world using tne Cortlnatorlal Geometry was found promising. 
The range data from successive locations of the robot during motion can be effectively confelned and given an 
adequate world representation. The pre- lea mod knowledge and moving objects In the scene can be effectively 
verified and represented In the world model. The computation time per "picture* Including the simulated range 
scan, modeling the geometry, trajectory planning and plotting the plane of «>t1on was 30 s to 1 min CPU time of 
VAX-8800 Computer, depends upon the scene complexity and the number of tentative paths considered. More than 
SOt of the computation time Is used for plotting the pine of motion and for calculating distances In a given 
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direction from discrete points. These calculations can be executed Independently and therefore, performing the 
same calculations on a parallel or concurrent computer may significantly reduce the computation time. Future 
work using the proposed external world modeling approach will focus on the following Issues: scene segmentation 
Into objects, feature point extraction, recognition of 3-D objects from range data, replacing the sphere repre- 
sentation with a more concise C6 volumetric representation of the recognized objects and finally Implementation 
of this method on the NCU8E Michlne and experimental verification using the HERMIES-11 robot. 
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